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The real timd visible and/or near infrared (V1S/NIR) and middle knd/or long infrared * * " r fir 1 

(MIR/LIR) £i :sion system is shown in Fig. 3B. The thin film coai ed beam splitter 1 will pass p 
almost 1 00% of the VIS/NIR radiation in 0.38 to 1.1 |x and refle< t almost 1 00% of the ** 
MIR/LIR rad iation in 3 - 12 n (MIR: 3 - 5 \x and LIR: 8 - 12 u) from the same target Two 
independent < objective lenses Li and L 2 can have the same field o : view (FOV) or different 
FOVs. The ly IR/LIR can have a large FOV for target searching t tnd the VIS/NIR can have a 
narrow FOV ! for target tracking and identification- They also can have the same FOV to do 
pixel by pixe dual-band fusion. Both sensors can have. dual FO\fs to match each other. 

However, ev< \n the VIS/NIR and MIR/LIR have the same FOV b ecause they have different 
pixel sizes, p xel numbers, and focal plane array formats two im« ges still cannot do pixel by 
pixel overlay We must use a formatting circuit to interpolate pix sis and scale images to let two 
images exact y have the same size then we can send them to die ; mage fusion board for fusion. 
The fusion be >ard must have the capability to move one image up and down or left and right to 
overlay it on the other image in real time because the beam splitt sr and other factors will cause 
image shift al though the common optical aperture and axis can u move the parallax between 2 
sensors so th< i most difficult operation - real time image rotation is not necessary to perform. It 
can be seen f :om our design that it doesn't matter the target is cl< >se or far we always can do 
real time digi tal pixel by pixel (same FOV) or picture in picture ( different FOVs) image fiisioa 
As shown in ?ig* 3B, we also can do simultaneous optical and dig tal fusion; its working 
principle is ai follows: 

The VIS/NIB radiation passes beam splitter 1 will be focused on image intensifier (I 2 ) tube by 
lens Li to ere ite green image at peak 0.55 n, this optical image vsi ill be imaged on human eye 
through lens \ ^ beam splitter 2, beam combiner, and lens Ls- The M [R/LIR radiation reflected by 
beam splitter 1 and mirror 1 will be focused on uncooled or cool< sd focal plane array (FPA) by 
lens L& and t &e electronic image will be converted to a visible in iage on liquid crystal display 
(LCD 1) or o her displays by the IR circuit board. This optical in age also will be imaged on 
human eye th rough lens L4, mirror 2, beam combiner, and lens L5. ' teal time optical fusion is 
realized. The beam combiner has special coating to allow almost 1 00% of 0.55 ±0.1 fi green 
light to pass I iut will reflect almost 100% of other visible lights s > both VIS/NIR and MIR/LIR 
images will n ot reduce intensity. The green light from the I tube will be near 80% reflected by 
beam splitter 2 then imaged on CCD through mirror 3 and lens L The electronic image will 
be sent to the sensor fusion board after using A/D converter and 1 ZCD circuit board. Similarly, 
the electronic image from the UFPA or CFPA also will be sent tc the sensor fusion board after 
using A/D an i formatting board. Since the CCD and IR FPA haV e different pixel sizes and 
numbers and different formats, it is necessary to use the formatting board to interpolate pixels 
and scale the image to let the IR image and CCD image have the same size so we are able to do 
pixel by pixe ; fusion in real time. Of course we also can do pictu e in picture fusion. From the 
above descrij tion we can see that we have realized simultaneous optical and electronic dual- 
band image f ision from the same target in real time. The fused ii lage can either have digital 
output or ana! og output through D/A converter. Both digital and j malog images can have 
wireless com nunication. The optical fusion can keep the I 2 imag $ with high resolution for 
better observi ttion and the digital fusion can do computer image j processing and digital 
recording. Be th fused images are useful If we use CCD not I 2 tu )e, the Li will directly focus 
on CCD. Opt cal fusion is not necessary to use and we will use tl ne digital fusion only. 


/ 


long infrared / * 


PAGE 1/2' RCVD AT 11/24/2006 2:07:01 PM [Eastern Standard Time] * SVR:USPTMFXRMJ11 * DNIS:2738300 * CSID:9374273252 * DURATION (mm-ss):01O4 


